"The highlighted tokens are primarily non-English characters or syllables from various languages, often representing morphemes, suffixes, or inflections that are important for grammatical structure or meaning within their respective languages. These tokens frequently appear in the middle or end of words, indicating their role in word formation or modification."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.71 | 0.636 | 0.98 | 0.772 | 0.98 | 0.44 | 0.56 | 0.02 |
fuzz | 0.59 | 0.554 | 0.92 | 0.692 | 0.92 | 0.26 | 0.74 | 0.08 |